How the Agency Measures Its Performance
In the Accountability Report and the Annual Restructuring Report, the agency was asked to provide information about how it measures its own performance. Performance measures are used to gauge whether or not the objective is being accomplished efficiently and the intended results are being achieved. There are four types of Performance Measures: (1) outcome measures, (2) efficiency measures, (3) output measures and (4) input or explanatory measures.
Agencies should focus on efficiency and outcome measures. Efficiency measures measure the amount of resources required to produce a single unit of output. Outcome measures measure what occurs as a result of the outputs (i.e. what happens when someone uses the output.). Focusing on these types of measures allow the agency to determine what changes can be made to continually improve tangible outcomes and do so at lower costs and faster speeds.
Below is the list of performance measures provided by the agency with the type of measure each one is considered by the agency. The Committee may or may not agree each measure is the type indicated by the agency but will examine them and work with the agency when the agency is under study. After the list of performance measures are additional details, including the targets and results, for each performance measure. This information was provided by the agency in its Annual Restructuring Report, Program Evaluation, Request for Information, or Accountability Report.
Click on any of the links below to go to the applicable part of this webpage:
Summary
Provide Input
Performance Documents
Performance Details
Summary (Click on a measure below to see additional details)
The type of measure indicated (e.g. input, output, effiency, etc.) was provided by the agency. The Committee may or may not agree that each measure is the type indicated by the agency.
Input/Activity
None
Output
Efficiency
None
Outcome
Provide Input
Do you think the agency is using the right performance measures or are there others you would like to see the agency use? Submit your input
here.
Type of Measure: Outcome
Required by: Only Agency Selected
Applicable Objectives: 1.3.2
Results
2013-14 Actual Results: 980 ERS Post Tests Completed, Average Increase of 12%
2014-15 Target Results: All participating centers assessed per standards
2014-15 Actual Results: 980 ERS Post Tests Completed, Average Increase of 12%
2015-16 Minimum Acceptable Results: All participating centers assessed per standards
2015-16 Target Results: All participating centers assessed per standards
Details
Why was this performance measure chosen? To ensure common, statewide outcome measures the First Steps Board of Trustees requires all child care quality enhancement programs to assess clients pre- and post-using the Environment Rating Scales, a set of valid and reliable measures recommended by external evaluators.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? SC First Steps Board of Trustees Accountability Standards
Client visit intensity and duration data
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 1.2.1
Results
2013-14 Actual Results: 2.25 visits per month, 1.18 hours in avg. duration (Parents as Teachers)
2014-15 Target Results: 2 visits per month, 1 hour in avg. duration (Parents as Teachers)
2014-15 Actual Results: 2.18 visits per month, 1.14 hours in avg. duration (Parents as Teachers)
2015-16 Minimum Acceptable Results: 2 visits per month, 1 hour in avg. duration (Parents as Teachers)
2015-16 Target Results: 2 visits per month, 1 hour in avg. duration (Parents as Teachers)
Details
Why was this performance measure chosen? To ensure the desired outcomes, research suggests that clients need home visitation services of sufficient intensity and duration, particularly those at high-risk.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? SC First Steps Board of Trustees Accountability Standards require 2 visits per month, averaging 1 hour in duration. High risk clients whose family schedules permit may be seen more frequently.
Client visit risk factor/demographic data (Objective 1.2.2)
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 1.2.2
Results
2013-14 Actual Results: Figure unavailable due to system malfunction at time of reporting
2014-15 Target Results: 60% possess two or more risk factors
2014-15 Actual Results: 88.8% possess two or more risk factors
2015-16 Minimum Acceptable Results: 60% possess two or more risk factors
2015-16 Target Results: 85% possess two or more risk factors
Details
Why was this performance measure chosen? To ensure service to South Carolina's most high-risk children and families, the First Steps Board of Trustees requires that at least 60% of home visitation clients possess two or more identified school readiness risk factors.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? SC First Steps Board of Trustees Accountability Standards
Client visit risk factor/demographic data (Objective 1.2.3)
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 1.2.3
Results
2013-14 Actual Results: Percent of cases that meet requirement: 93.77%
2014-15 Target Results: 90% or greater meeting requirement
2014-15 Actual Results: Percent of cases that meet requirement: 90.99%
2015-16 Minimum Acceptable Results: 90% or greater meeting requirement
2015-16 Target Results: Percent of cases that meet requirement: 92%
Details
Why was this performance measure chosen? To ensure common, statewide outcome measures the First Steps Board of Trustees requires all home visitation programs to assess clients pre- and post-using the Keys to Interactive Parenting Scale (KIPS) and Adult-Child Interactive Reading Inventory (ACIRI). Both are valid and reliable measures recommended by external evaluators.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? SC First Steps Board of Trustees Accountability Standards
Completion of School Readiness Description required under 59-152-32
Type of Measure: Output
Required by: State
Applicable Objectives: 2.2.1
Results
2013-14 Actual Results: N/A
2014-15 Target Results: N/A
2014-15 Actual Results: N/A
2015-16 Minimum Acceptable Results: Creation and adoption of Interagency School Readiness Description
2015-16 Target Results: Creation and adoption of Interagency School Readiness Description
Details
Why was this performance measure chosen? Required under 59-152-32
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? Required under 59-152-32
Completion of upgrades and addressing of interagency connectivity within the BRIDGES data system
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 1.4.2
Results
2013-14 Actual Results: N/A
2014-15 Target Results: N/A
2014-15 Actual Results: N/A
2015-16 Minimum Acceptable Results: Improvements to BRIDGES underway
2015-16 Target Results: Improvements to BRIDGES completed
Details
Why was this performance measure chosen? Improvements to the BRIDGES data system are necessary to improve BabyNet's system of payments, to collect data required by the US Department of Education and improve connectivity with partner data systems.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? N/A
Convene Interagency Work Group/Development of Interagency Child Care Plan
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 3.1.1
Results
2013-14 Actual Results: N/A
2014-15 Target Results: N/A
2014-15 Actual Results: N/A
2015-16 Minimum Acceptable Results: Successful development of Interagency Child Care Plan
2015-16 Target Results: Successful development of Interagency Child Care Plan
Details
Why was this performance measure chosen? To improve collaboration and interagency coordination in the area of child care.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? First Steps and DSS play important, complementary roles within the childcare community, with DSS serving as regulator and First Steps supporting program quality.
Expanded Staffing
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 1.4.1
Results
2013-14 Actual Results: N/A
2014-15 Target Results: N/A
2014-15 Actual Results: N/A
2015-16 Minimum Acceptable Results: 23 New FTEs deployed
2015-16 Target Results: 23 New FTEs deployed
Details
Why was this performance measure chosen? This staffing is necessary to speed delivery of early intervention services to infants and toddlers with disabilities and developmental delays within the identified federal 45 day timeframe.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? This request was based on data regarding the number of referrals make to BabyNet annually (approximately 10,000) and the number of hours required to process each under IDEA, Part C.
Partnership Site Visits Completed
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 2.1.1
Results
2013-14 Actual Results: N/A - This objective relates to a specific initiative during the summer of 2015.
2014-15 Target Results: N/A - This objective relates to a specific initiative during the summer of 2015.
2014-15 Actual Results: N/A - This objective relates to a specific initiative during the summer of 2015.
2015-16 Minimum Acceptable Results: 46
2015-16 Target Results: 46
Details
Why was this performance measure chosen? In preparation for the Board's 2015 strategic planning effort, it was decided that each partnership would receive a site visit during the summer of 2015. Delegations comprised of State Trustees, Senior Staff and representatives from the County Technical Assistance, 4K and BabyNet teams visited each of 46 counties to gather feedback on successes, challenges, concerns and needs.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? Visits to 100% of partnerships by the state office and State Board during the summer of 2015.
Plan and convene 2015 Chairmen's Summit on Early Childhood, a collaborative effort between the First Steps Board of Trustees, and House and Senate leaders for children
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 3.1.2
Results
2013-14 Actual Results: N/A
2014-15 Target Results: N/A
2014-15 Actual Results: N/A
2015-16 Minimum Acceptable Results: Plan and convene 2015 Chairmen's Summit on Early Childhood.
2015-16 Target Results: Plan and convene 2015 Chairmen's Summit on Early Childhood.
Details
Why was this performance measure chosen? First Steps is charged by law with both the mobilization of communities around the needs of young children and fostering interagency collaboration as a means through which to ensure efficiency.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? N/A
Public awareness campaign
Type of Measure: Output
Required by: State
Applicable Objectives: 2.2.2
Results
2013-14 Actual Results: N/A
2014-15 Target Results: N/A
2014-15 Actual Results: N/A
2015-16 Minimum Acceptable Results: Launch of statewide [I CAN] school readiness campaign.
2015-16 Target Results: Launch of statewide [I CAN] school readiness campaign.
Details
Why was this performance measure chosen? First Steps has a statutory goal to mobile communities around the needs of young children. This school readiness public awareness campaign is designed to promote the state's new school readiness definition.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? N/A
Student and Provider Enrollment Counts
Type of Measure: Output
Required by: State
Applicable Objectives: 1.1.1
Results
2013-14 Actual Results: 1,402 students, 93 providers
2014-15 Target Results: 1,612 students, 107 providers
2014-15 Actual Results: 1,916 students, 151 providers
2015-16 Minimum Acceptable Results: 2,203 students, 174 providers
2015-16 Target Results: 2,653 students, 185 providers
Details
Why was this performance measure chosen? Concrete measure of both student and provider enrollment growth.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? 15% increases annually
Technical assistance intensity and duration data
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 1.3.1
Results
2013-14 Actual Results:
2014-15 Target Results: At least 2 visits per month, per center
2014-15 Actual Results: 2.14 visits per month, per center average
2015-16 Minimum Acceptable Results: At least 2 visits per month, per center
2015-16 Target Results: 2.14 visits per month, per center average
Details
Why was this performance measure chosen? To ensure the desired outcomes, research suggests that clients need technical assistance of sufficient intensity and duration to meaningfully increase quality.
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? SC First Steps Board of Trustees Accountability Standards
Technical Assistance Visit Counts
Type of Measure: Output
Required by: Only Agency Selected
Applicable Objectives: 1.1.2
Results
2013-14 Actual Results: 1,674 site visits
2014-15 Target Results: 2x monthly per center enrolled
2014-15 Actual Results: 2,718 site visits
2015-16 Minimum Acceptable Results: 2x monthly per center enrolled
2015-16 Target Results: 3,300 site visits
Details
Why was this performance measure chosen? Concrete measure of provider technical assistance
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? Twice a month per center enrolled
Training and Assessment Implementation
Type of Measure: Outcome
Required by: State
Applicable Objectives: 1.1.3
Results
2013-14 Actual Results: N/A
2014-15 Target Results: N/A
2014-15 Actual Results: N/A
2015-16 Minimum Acceptable Results: All First Steps 4K students assessed in Fall, Mid-Year and Year End.
2015-16 Target Results: All First Steps 4K students assessed in Fall, Mid-Year and Year End.
Details
Why was this performance measure chosen? Required by Proviso 1A.77
What was considered when determining the level to set the target value in 2015-16 and why was the decision finally made on setting it at the level at which it was set? Proviso 1A.77 (SDE: Early Literacy Competencies Assessments)
Performance Measures Explained
There are four types of Performance Measures: (1) outcome measures, (2) efficiency measures, (3) output measures and (4) input or explanatory measures.
Outcome Measure - A quantifiable indicator of the public and customer benefits from an agency's actions. Outcome measures are used to assess an agency's effectiveness in serving its key customers and in achieving its mission, goals and objectives. They are also used to direct resources to strategies with the greatest effect on the most valued outcomes. Outcome measures should be the first priority. Example - % of licensees with no violations.
Efficiency Measure - A quantifiable indicator of productivity expressed in unit costs, units of time, or other ratio-based units. Efficiency measures are used to assess the cost-efficiency, productivity, and timeliness of agency operations. Efficiency measures measure the efficient use of available resources and should be the second priority. Example - cost per inspection
Output Measure - A quantifiable indicator of the number of goods or services an agency produces. Output measures are used to assess workload and the agency's efforts to address demands. Output measures measure workload and efforts and should be the third priority. Example - # of business license applications processed.
Input/Explanatory/Activity Measure - Resources that contribute to the production and delivery of a service. Inputs are "what we use to do the work." They measure the factors or requests received that explain performance (i.e. explanatory). These measures should be the last priority. Example - # of license applications received
Staff Portal
